Key Responsibilities

• Create & maintain data pipelines using Azure & Snowflake as primary tools
• Create SQL-stored procs and Functions to perform complex transformations
• Understand data requirements and design optimal pipelines to fulfill the use cases
• Creating logical & physical data models to ensure data integrity is maintained
• Code management, CI/CD pipeline creation & automation using GitHub & GIT Actions
• Tuning and optimizing data processes
• Design and build best-in-class processes to clean and standardize data
• Code Deployments to the production environment, troubleshoot production data issues
• Modeling of big volume datasets to maximize performance for our Business Intelligence & Data Science Team
  
  

Required Qualifications/Skills

• Computer Science bachelor's degree or similar
• Min 4 years of industry experience as a Hands-on Data engineer
• Excellent knowledge of SQL
• Excellent knowledge of Azure Services such as – Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault, etc.
• Excellent knowledge of Snowflake - Architecture, Features, Best practices
• Excellent understanding of Data warehousing & BI Solutions
• Excellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc.

Preferred Skills

• Knowledge and experience in Terraform, CI CD Pipelines, and automation is an advantage
• Automation and orchestration using ADF
• Create real-time analytics pipelines using Snowpipe Streaming
• Experience developing optimized data models for Viz tool E.g. Tableau, PowerBI is an Advantage
• Exposure and experience in other programming languages such as Python, Spark, etc. is an advantage
• Hands-on experience of CI-CD Pipelines using GIT & GIT Actions
• Understanding of United States Healthcare data and applicable regulations.

Posted By